CM 
< 



in 

00 



a 

UJ 



J 



EuropSfsches Patentamt 
European Patent Office 
Office europeen des brevets 



iiiiiliiiilllli 

(11) EP 1 182 585 A2 



(43) Date of publication: 

27.02.2002 Bulletin 2002A)9 



EUROPEAN PATENT APPLICATION 

(51)'lntCI.7: G06F 17/30 



(21) Application number 01202975.7 

(22) Date of filing: 06.08.2001 



(84) Designated Contracting States: 


(72) Inventors: 


AT BE CHCYDEDKES 


Fl FR QB GR IE IT LI LU 


• Squllla, John R., c/o Eastman Kodal( Company 


MCNLPTSETR 




Rociiester, New York 14650-2201 (US) 


Designated Extension St 


ites: 


• Mclntyre, Dale P., c/o Eastman Kodak Company 


ALLTLVMKROSI 




Rochester, New York 14650-2201 (US) 


(30) Priority: 17.08.2000 US 


640938 


(74) Representative: 






Nunney, Ronald Frederick Adolphe et al 


(71) Applicant: EASTMAN KODAK COMPANY 


Kodak Limited, Patent Department (W92)-3A, 


Rochester, New York 14650 (US) 


Headstone Drive 






Harrow, Middlesex HA1 4TY (GB) 



(54) A method and system for cataloging images 

(57) A method and computer software product for 
the categorization and/or retrieving of digital images. At 
least one selection category having at least one image 



teon Is provided for association with the image to be cat- 
egorized and^or retrieved. The software product is de- 
signed for personalization by the user and allows the 
formation of personalized image Icon. 
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Description 

[0001 1 The present invention Is directed to cataloging 
of digital Innages. More particularly, the software and 
system for cataloging digital images into an electroni- 
cally stored collection or library. 
[0002] Photographs are taken for a variety of personal 
and business reasons. During the course of the year an 
individual nnay take numerous photographs of various 
events. During these events, quite often there is a vari- 
ety of different individuals and items present in these 
photographs. In the prior art, when one desires to cata- 
log these images in a particular order, they usually are 
left to placing these images manually into photograph 
albums. This Is a very extensive, manual procedure re- 
quiring a significant amount of time. In addition, it Is very 
limited with regard to the amount of Information that can 
be associated with the bnage in a quick and easy man- 
ner While some photo albums allow the writing and 
placing of text, the entering of this data is a very time 
consuming and arduous affair. Once having sorted 
these Images Into particular abums whtoh may repre- 
sent categories of interest, it is extremely diff toult to re- 
trieve and/or reorganize the images into other catego- 
ries. With the advent of digital cameras and digital im- 
aging, it is known that these images can be stored in 
databases. However, there is no easy and quick or effi- 
cient way for cataloging of these Images, retrieving and/ 
or reorganizing these Images. 
[0003] Applicants have invented an efficient method 
and system for organizing digital images in a quick and 
efficient manner. The organized images can be easily 
retrieved and reorganized by a variety of criteria. 
[0004] In accordance with one aspect of the present 
invention there Is provided a computer software product 
comprising a computer readable storage medium hav- 
ing a computer program wheh when toaded into a com- 
puter of an image fonning devkse causes the computer 
to perform the following steps; 

displaying at least one Image for categorization; 
providing at least one selection category having at 
least one image association Icon that can be asso- 
ciated with the image to be reviewed. 

[0005] In accordance with another aspect of the 
present invention there is provided a method for organ- 
izing a plurality of images comprising the steps of: 

displaying at least of the plurality of images; 
categorizing at least one of the plurality of images 
using an image Icon for at least one selection cate- 
gory. 

[0006] In accordance with yet another aspect of the 
present invention there is provided a computer software 
product comprising a computer readable storage medi- 
um having a computer program whteh when loaded Into 



a computer of an image fomilng device causes the com- 
puter to perform the foNowing steps: 

retrieving at least one image from a plurality of im- 
5 ages that have been previously categorized; 

providing at least one selection category having at 
least one image association toon that can be asso- 
ciated with the image to be reviewed. 

10 [0007] In accordance with still another aspect of the 
present Invention there is provided a method for person- 
alizing an image computer software program, compris- 
ing the steps of; 

IS a. providing a categorization/retrieval program that 
uses categories and image Icons for use in catego- 
rizing and/or retrieving digital images; 
b. selecting from a plurality of stored categories at 
least one selection category; and 

20 c. selecting from a plurality of stored image icons at 
least one image icon for use with at least one se- 
lectton category. 

[0008] In accordance with another aspect of the 
25 present invention there is provided a method for retriev- 
ing an image from a plurality of images that have been 
previously categorized, comprising the steps of: 

retrieving at least one image from a plurality of im- 
30 ages that been previously categorized; 

providing at least one selection category having at 
least one image association toon that can be asso- 
ciated with the image to be reviewed. 

35 [0009] In accordance with yet still another aspect of 
the present Invention thei« is provided a method for au- 
tomatically organizing a plurality of images comprising 

the steps of: 

40 providing at least one Image toon associated with a 
category, 

using predetennined characteristtos of the icon for 
use in identifying non-categorized Images for asso- 
ciation with the category. 

45 

[0010] In accordance with another aspect of the 
present invention there Is provided a computer software 
product for automatically categorizing images compris- 
ing a computer readable storage medium having a com- 
50 puter program which when loaded into a computer of an 
image forming device causes the computer to perfonn 
the following steps: 

providing at least one image Icon associated with a 
ss category, 

using predetermined characteristics of the toon for 
use In Identifying non-categorized images for asso- 
ciation with the category. 
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[0011] The above, and other objects, advantages and 
novelfeatures of the present invention willbecome more 
apparent from the accompanying detailed description 
thereof when considered in conjunction with the follow- 
ing drawings. 

[001 2} In the detailed description of the pref ened em- 
bodiments of the Invention presented below, reference 
Is made to the accompanying drawings In which: 

Fig. 1 is a schematic diagram of a system for use in 
practicing the present Invention; 
Fig. 2 is flow chart of the operation of a computer 
software program made in accordance with the 
present Invention; 

Figs 3A-3hl Illustrates various display screens that 
are developed as a result of the use of the software 
program made according to the present Invention; 
F^. 4 is a flow diagram of the how a new Icon or 
test identifier may be added to the selection menu; 
and 

Figs. SA and SB Illustrate a display screen a modi- 
fied fonn of the present Invention. 

[001 3] Referring to Figure 1 there is illustrated a sys- 
tem 10 made in accordance with the present invention. 
The system Includes a computer 12 for processing data 
and infonnatlon. The computer 12 also Includes an ap- 
propriate processor and memory storage forthe running 
of software programs and storing of digital data as Is 
customarily done by computers. In the embodiment Il- 
lustrated, computer 12 is a personal computer having a 
display device 14 which in the particular embodiment is 
a CRT, The computer 12 also includes input devices 16 
and 18 for entering of data into the computer 12 by the 
user. In particular, input device 1 6 Is a l<eypad and input 
device 18 Is a mouse. However, it is to be understood 
that any Input device or means may be employed, for 
example, but not by way of limitation to, a voice recog- 
nition system. A scanner 20 is provided for scanning of 
hard copy images for obtaining digital files of images. 
The scanned images are digitized and forwarded to 
computer 12 as is well l<nown in the art. Computer 12 Is 
also provided with appropriate communication hard- 
ware and software, as is well known in the art, for allow- 
ing communication with third parties, in the embodiment 
illustrated, the communication hardware and software 
allows communication to an internet service provider 
ISP 22 which in turn allows communication with the in- 
ternet 24. The internet 24, as is well Itnown, allows elec- 
tronic communication with various other parties. The 
system 1 0 also includes a photoservice provider 26 ca- 
pable of providing digital imaging goods and/or services. 
These goods and services may be requested by cus- 
tomers over the internet 24 or by any other means, for 
example, but not by way of limitation through the use of 
order envelopes containing image products having im- 
ages thereon. The ordered goods and/or services may 
be provided to the customer over the internet 24 or by 
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forwarding such goods and/or services directly to the 
customer through the mail, or other delivery system. As 
is illustrated, a third party 28 may also be connected to 
internet 24 for communication with others that are con- 

5 nected to internet 24. 

[0014] Referring to Figure 2, there is illustrated a flow 
diagram of the operation of a computer software pro- 
gram made in accordance with the present Invention. 
The software program is designed such that when load- 

10 ed onto a computer, it will cause the computer to pert om 
the steps set forth in Figure 2. In particular, the first step 
30 of software program allows the user to obtain digital 
images from any appropriate source. For example, as 
Illustrated by Figure 1, digital images may be obtained 

15 by scanning of Images by the user, or from a digital de- 
vice such as a digital camera, or from a stored digital 
data file on the computer 12. Alternatively, the Images 
may be obtained from the third party 28 over a commu- 
nication network such as the Internet 24. For example, 

20 a roll of photographic film may have been sent to servtee 
provider 26 where the film would have been developed 
and digitally scanned so as to provide a digital record of 
the images contained thereon. The scanned digital im- 
ages would then be forwarded to the user over the in- 

ss temet 24 and ISP 22 allowing access by the user at com- 
puter 12. in the next step 32, the selected images are 
reviewed and categorized. After completion of step 32, 
the Images at step 34 are used as desired. For example, 
the categorized Images would be sent to a data storage 

30 file, to a third party, a service provider for obtaining de- 
sired goods and/ or services, or possibly to a printer 
[001 5j Refemng to Figures 3A - 3G there Is illustrated 
a series of computer display screens that illustrate the 
use of the computer software program of the present 

35 Invention. Referring to Figure 3A there is illustrated a 
computer screen which Illustrates one of the first 
screens viewed by the user when the program Is acti- 
vated. In the particular embodiment Illustrated there are 
various choices provided to the user. In particular, the 

40 user may obtain images by selecting item 1 in whnh 
case, by selecting this item, options wilt be provided for 
the user. For example, obtaining images from a scanner, 
a digitalcamera 27 (see Fig. 1 ), from a third party source 
such as a service provider, friend, relative, or business 

45 associate, etc. It is to be understood that the digital im- 
ages may be obtained from any appropriate source. An- 
other option is to open an existing digital data file con- 
taining digital images. In the embodiment illustrated, the 
user has selected the first option of obtaining a digital 

50 image on file. Figure SB illustrates the first working 
screen 40 after the image or images that have been ob- 
tained and are ready for cataloging. As illustrated by Fig- 
ure 3B, the initial working screen 40 has a working win- 
dow 41 in which the image or images to be cataloged 

ss will be displayed. When a plurality of images are to be 
cataloged, the images will be sequentially displayed in 
window 41 until the user Is done cataloging the selected 
images. As illustrated by Figure 3B, the first image 43 
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is illustrated in window 41 . The working screen 39 in- 
cludes at least one selection category for categorizing 
of images. It is to be understood that any desired 
number of selection categories may be provided by the 
software program or created by the user. In the particu- 
lar embodiment, there is provided five (5) selection cat- 
egories 40, 42, 44, 46, and 48. In particular selection 
category 40 Is directed to *Who", meaning who are the 
Individuals in the image 44 that are to be identified with 
the image. In selection category 40, there is provided a 
plurality of the image icons 50, 52, 54, and 56 for allow- 
ing the user to qutekly and easily categorize the image 
44. In the particular embodiment illustrated, the icons 
50, 52, 54, 56 are individuals that are In some way 
known to the user. There Is also provided a list of text 
identifiers 51 , 53 and 55 which can also be used to as- 
sociate Infonnation with the image. The identifiers may 
correspond to the icons 50, 52, 54 and 56 if so desired. 
In the parttoular embodiment illustrated, icon 50 identi- 
fies Individual name "Dan", Icon 52 identified the Indi- 
vidual 'Sally", icon 54 klentifies "Mom* and icon 56 iden- 
tifies 'Dad". It is, of course, understood that the various 
Icons can be used to Identify anyone or subject desired 
by the user. As discussed later herein, these individual 
icons may be personalized in accordance with the wish- 
es of the user. Thus, each of the icons can represent a 
name, a relationship, or any other desired reference. In 
the embodiment Illustrated, the icons 50 - 56 each refer 
to Individuals. However, these Icons could have also re- 
ferred to groups of individuals. For example, family, 
choir, co-workers, etc. Of particular Interest Is that the 
icons Illustrated In selection category 40 are all person- 
alized according to the user and provide quick visual 
Identlftoation of the category. In the embodiment Illus- 
trated, the Icons are actually images of the individual 
Identified as 'Dan', 'Sally', 'Mom', or 'Dad". Thus, if in 
the Image 43 there is Illustrated an image of "Mom" and/ 
or "Sally", in order to associate that Infonnation with Im- 
age 43, the user would take an appropriate selection de- 
vice, for example, the use of a mouse 1 8 or keyboard 
1 6 whereby a selection arrow will be placed over the two 
appropriate Icons and selected. As Illustrated in Figure 
3C, display window 50 displays the information that Is 
to be associated with the image 43. In the embodiment 
illustrated, both text and visual icons with be associated 
with the image 43. As shown by Fig. 3C, the individuals 
have been identified as "Joanne" and "Noah". This in- 
formation (meta data) is attached to the Image file which 
can be used for searching and/or displaying of Informa- 
tton when the Images are later searched and/or dis- 
played. 

[0016] An add button 49 is provided in association 
with selection category 40 so that new icons and/or text 
identifiers may be provided for selection by the user. For 
example, during viewing of an Image In window 41, a 
new individual may be viewed and the user virishes to 
associate this new Individual with this frnage and possi- 
ble other images. By selecting the add button 49, an ar- 
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row should show up on the image that would allow the 
user to identify an area of the image, for example, the 
portion of the image where this new individual is located. 
In Fig. 3C, the selected area is indicated by dash line 

s 57. Then the user can select that this area be created 
as a new selection icon for selection category 40. Alter- 
natively or in addition thereto, new text identifier by itself 
or In conjunction with the Icon could be created. The new 
feon or text identifier can then be used in categorizing 

10 images provided in window 41 in the same manner as 
the other teons. 

[0017] Alternatively, add button 49 could initiate a di- 
alog box wherein a user could specify a specific location 
or universal resource locator (URL) on the Internet 24 

IS of a third party who provides pre-constructed teons with 
associated text Mentlfiers for dovmloading into the soft- 
ware. These Icons may be provided for a fee or they 
may be provided for free if the user provides some in- 
fonmation. The downloaded icons are automatically as- 

20 signed to the proper selection category or if appropriate, 
new categories are automatically created to contain the 
downloaded toons. 

P018] Refeaing to Figure 3D, the "What" selectton 
category 42 is selected by the user Selection category 
42 has various icons which identify particular events and 
also a corresponding list 59 set forth. Any one of the 
teons 58, 60, 62, 64 or selection items 63, 65, and 67 
may be selected. As with selection box 40 there Is the 
ability to add additional Information by the add button 70 

30 which operates In the same manner as button 49 previ- 
ously discussed. Once the appropriate selections have 
been made, the information associated with the select- 
ed teons or text will be displayed in display window 80. 
[001 9] The next selection category 44 in the particular 

35 embodiment illustrated is the "When*. As illustrated by 
Fig. 3E, the 'When' category comprises a category 
wherein a date may be entered. The date may be the 
date of capture of the image or the date when the user 
is using the program. In the embodiment illustrated, the 

40 date of manipulation of the image will be automatically 
entered if there is no previous date supplied. However, 
the date may be provided with the original Rnage. For 
example, there currently exists the APS photographte 
system whteh uses a film strip having a magnetic layer 

« upon which information can be provided by the camera 
that captures the image. Various types of infonnation 
can be added by the camera that can used later in the 
photofinishing process. An example of such Information 
is the date. This informatton can be maintained with the 

so image and when the image Is digitally scanned by a 
service provider, the date recorded on the film can be 
associated with the image. The service provider may 
download the image to the user in which case the date 
downloaded can be imported automatically into the pro- 

ss gram used by the user. It is to be understood that any 
other pertinent data may be added automatteally to the 
cataloging program. For example, but not way of limlta- 
tton, additional data may be provided on the scanned 
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film, provided by way of a digital camera, or even by a 
third party souice such as the photoflnisher. 
[0020] Referring to Figures 3F, the next selection cat- 
egory 46 "Where* is illustrated. In the particular embod- 
iment Illustrated there are four icons, 82, 84, 86, and 88 
which can be selected for association with the image in 
window 42. In addition, as previously discussed, a se- 
lection window having other information such as person- 
alized places can be added. For example, in the embod- 
iment illustrated by items 88 and SO, two additional plac- 
es are provided, I.e., Canada and/or Clinton, New Yorl<. 
The Icons 82, 84, 86, and 88 respectively referto images 
or places directly associated to the consumer. For ex- 
ample, the first icon may represent a work location, the 
icon 84 can represent home, the third icon can represent 
a particular place or theme park that was visited, and 
the last icon 88, could represent a relative's place. Once 
having selected the appropriate "Where", this is entered 
In and illustrated In display window 94. As previously dis- 
cussed, additional new items may be added to the 
where category by the add button 96 which operates in 
the same manner as the other add buttons previously 
discussed. 

[0021] In the particular embodiment Illustrated, the 
last selection category 48 Is "Why". Referring to Figure 
3G, there is illustrated the reason why the people were 
gathered, in the particular embodiment illustrated, this 
is 'Ma's and Pa's* 50<'< anniversary party. This infonna- 
tion in the particular embodiment was manually entered 
and Is illustrated In display window 94. However, It Is 
desired that appropriate toons could be personalized 
and added for selection thereof. 
[0022] Figure 3H illustrates the screen whereby all the 
infomiation will be kept as entered or revised and is 
shown by display screen 97. The data is retained by de- 
pressing the enter key on the keyboard 1 6 or an equiv- 
alent button 101 provided on the screen. The next Im- 
age, if there is one, would then be presented for cate- 
gorizing. A retain button 98 Is provided so that the user 
can repeat the same selections made for the previous 
Image for the Image currently being displayed. If only 
some of the categories are to be the same for the next 
image, the retain button 98 can be selected and then 
editing of the desired category may be accomplished 
relatively quick and easy. Once the information has 
been properly provided for all of the images, the Images 
and associated Infonnation that has been entered is 
stored in a digital file or other appropriate digital memory 
storage device or location. Thus, anytime the Image Is 
reselected at a later time, the Informatton and search 
categories can be accessed and used as desired as dis- 
cussed later herein. 

[0023] The Icons used for selection calegories may 
be icons originally provided with the software program, 
provided by a third party, and/or as illustrated above the 
icon can be created and personalized by the user. In a 
similar manner, the selection categories may also be 
originally provided by the software program, provided 
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l>y a third party and/or created by the user. This allows 
the user to be able to use the program as initially pro- 
vided or personalize the software program with the de- 
sired categories and icons specifically suited to meet the 
s needs of the user. For example, the user would initially 
rewew a plurality of selection categories and Image 
teons and select the desired categories and icon for use 
with the program. Additionally, during this initial set-up, 
personalized categories and/or Icons may be added by 

10 the user as desired. Once the computer software pro- 
gram has been set-up, the categorization of Images by 
the user can proceed. The present Invention also allows 
the user to modify the selection categories and/or toons 
at any time by use of the add button 49, 70, or 96 as 

'5 previously discussed. New categories and/or icons may 
be automattoaily provided by third parties or by other de- 
vices. For example, if an individual Is using a camera at 
a theme park, meta data may be provided to the camera 
(digital or film-based) identifying a category and/or icon 

20 which would be read by a photoservice provider, the cat- 
egory and/or toon in turn would be provided with the dig- 
ital image file. For example, a new icon providing an Im- 
age of the theme park visited would be automatically as- 
sociated with each of the images captured at the theme 

25 park, if no category or Icon is present In the software 
that reads the icon and/or category, a new category and/ 
or icon will be automatically created by the software for 
use with the current image and any further images used 
with the software. 

30 p)024] The use of personalized toons and/or catego- 
ries allows for quicker and easier association of the im- 
age and providing of meia data associated with the im- 
ages. Further, the use of icons in the forni of an image 
allows qutoker and easier selection by the user as they 

3s are readily recognizable by the user and only require a 
simple citok of a selection device to select. 
[0025] The following is brief description on how a user 
would use the categorizing software of the present in- 
vention. In the beginning, user would obtain the desired 

40 image or images for categorizing. The images as previ- 
ously discussed may be obtained from any source. For 
example, as previously discussed, the images may be 
obtained from a roll of film that has been developed and 
scanned so as to provide a digital record of the Images 

IS which has been fonvarded to the user electronically or 
by hard copy devices such as a computer disc, flash 
cards, etc. Alternatively, the images may be simply ob- 
tained from a computer file that has been stored or re- 
ceived. Once the image or images have been retrieved, 

50 then the user would go through each of the selection 
categories for the desired images and associate the de- 
sired icons with the images. 

[0026] The user may also use the software to search 
and/or re-categorize digital images that have already 
55 been categorized. The user would identify a group or 
groups of images that have been prevtously catego- 
rized. Then the selection icons and/or text identifiers for 
the categories would be used as means for identifying 
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the group and/ or type of images desired. For example, 
if the user wanted ali of the images associated with Dad 
and birthday the appropriate icons wouid be selected 
and the FIND feature would be selected. This would re- 
sult In the images having these associated data being 
gathered. The user can then use the grouped images 
as desired. When the user has finished, the image can 
then be returned from where they were obtained. Alter- 
natively, the images may be used to create a new group 
or reorganize existing groups. The user may categorize 
and reorganize any or all the images as desired. The 
grouping of the Images being limited only by the icons 
and categories available to the user. As previously dis- 
cussed the categories and icons are selected as desired 
by user. 

[0027] The user may accept the Icons as orfeiinally 
provided or select a customized feature whereby per- 
sonalized icons can be added. This can be done at any 
time, Thus, the personal icons could be created Initially 
upon receipt of the software and installed into the com- 
puter or they can be created as images are viewed. It is 
desirable to have as many icons initially provided so that 
all the images will have consistent icons for later sorting 
as discussed later herein. However, as new Images are 
obtained, there is often a need to provide new and ad- 
ditional Icons. 

[0028] Referring to Figure 4, there is illustrated a flow 
chart illustrating how additional new icons can be added 
to the current selection categories. In Figure 4, the im- 
age icon may be added during viewing of the images for 
categorizing. In particularly step 1 00, a photo is selected 
because the user may realize a new Icon Is necessary. 
In step 102 after selection of the appropriate button for 
the adding of a new icon, a portion 200 of the image is 
selected for use as an loon. At this point, portion 200 of 
the Image may be optionally or automatically saved by 
the program in step 166 or 168 further retaining maxi- 
mum pixel resolution for use in searching and automat- 
ically cataloging images that have not been cataloged, 
the specifics of which will be discussed later. In the par- 
ticular embodiment illustrated, a square, representing 
the icon to be created, is placed around the portion 200 
of an image as desired by the user. In step 1 04, the se- 
lected image is property sized for use as an icon. Then 
the icon is added to the appropriate selection menu. Text 
information may be associated with the icon. Step 1 08 
provides for the typing of text. At step 110, a new iden- 
tifier is provided and at step 1 1 2, it is added to the list of 
identifiers. These identifiers may of course be associat- 
ed with a particular icon. Alternatively, an icon from a 
library supplied with the program or by a third party may 
be added as illustrated by steps 1 50 - 1 6B. In step 1 50, 
the user may decide to add an icon supplied by the pro- 
gram as shown in step 152 which is directly added to a 
category or he may choose to connect to a third party 
to download an icon from the third party library. The user 
chooses the third party download in step 1 54 by supply- 
ing a unhfersal resource locator (URL) to an Internet 



182 585 A2 10 

browsersuch as the Intemet Explorer browser produced 
by Microsoft Inc. The browser facilitates the network 
connection to the third party library supplier via the in- 
ternet 24. Some libraries might cause the user to incur 
5 a fee and such information to satisfy payment is supplied 
in step 158. Otherwise, the choice in step 156 leads to 
an icon selection step 160 followed by step 162 for 
downloading the Icon using standard intemet file trans- 
fer protocol (ftp). The downloaded icon is then added to 

10 a category in step 1 64. 

[0029] Referring to Fig. 5A, there Is illustrated a mod- 
ified display screen of the software made in accordance 
with the present invention, lil<e numerals indicating like 
items and operations as previously discussed, in this 

»5 embodiment, a pluraHty of images 120-139 are provided 
within window 42. In this embodiment, individual imag- 
es, selected groups of images, or all of the images may 
be categorized at the same time. For example, all of the 
images may be categorized as a group. Alternatively, 

^0 groups of images may be categorized. As illustrated by 
Fig. SB, images 1 22, 1 23, 1 24, 1 29 and 139 are selected 
for categorization. Once selected, the appropriated 
icons of the desired categories are selected and asso- 
ciated with the selected Images. If desired, the images 

2s may be selected Individually for categorization. This 
system Is particularly useful when receiving a plurality 
of images that were obtained from a single source, for 
example, a roll of photographic film, lyptoaily, images 
from a single source will have a number of common 

90 themes among the images. This set-up allows for the 
quick grouping and categorization of the images. Simi- 
lariy, when images are retrieved from a storage image 
file or files, the images can be viewed as a group allow- 
ing easier selection and/or reorganization. 

3S [0030] Once all the Images have been appropriately 
categorized and/or reorganized, they are fonvarded to 
a device for storage and use. The user may have a va- 
riety of options, for example, the printing, displaying 
and/or transmitting of the images with or without all of 

40 the associated images. One of the benefits of the 
present invention is that since ali of the images have 
associated data in a variety of different fields, the reclas- 
sification and reorganization of these images can be 
done in a qutok and easy manner by appropriately build- 

« ing a search request for reconstructing a recalling of im- 
ages. In particular, should someone want all of the pic- 
tures of "Grandpa" from a time period to a time period 
taken on birthdays, this could easily be retrieved by en- 
tering of the appropriate information in the appropriate 

so selection categories. It can thus be seen that any de- 
sired combination of groupings may be selected by the 
user for recategorizing of the images whteh can be used 
in a variety of different ways. For example, but not by 
way of limitation, the reorganized images may be sent 

55 and shared with other third parties over the intemet or 
fonvarded to an image service provider for production 
of image products to be delivered as a gift to a third party. 
For example, associated photo imagesmay be provided 
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as a photo album or album pages which can be sent to 
a third party. For example, images that were taken over 
years of sporting events may be sent to a grandparent 
for their use and review in any desired manner. The 
grouping of images can also be very useful in ordering 
of certain goods and/or services. For example, if album 
pages are being ordered, the grouping of the images by 
desired categories could be a first step in placing the 
image in the desired grouping and order. 
[0031 ] Thus, it can be seen that the vast library of im- 
ages can now be reaccessed and reorganized as de- 
sired by the user or any recipient who has access to the 
images. Likewise, the software used (or organizing and 
retrieving the images could also be fonwarded with the 
images to a third party so that the third party may be 
able to use these images in the same manner as the 
user that forwarded the Images. 
[0032] In the particular embodiment illustrated, the 
software program Is illustrated as being run on a com- 
puter that the user has direct access. The present in- 
vention is not so limited. For example, the program may 
reside at a remote location, such as a photosenrice pro- 
vider that can be accessed over communicatton iinics, 
such as the internet, in such case, the software program 
and maybe even the Innage to be categorized may be 
stored. 

[0033] In the preceding discussion, the invention has 
shown the creation and use of the image icons to assist 
the user In the cataloging of Images. Refening once 
again to step 1 66 of Fig. 4, the maximum pixel resolution 
of the portion 200 of the image to be used for an icon 
has been saved for use in searching and automatically 
cataloging images that have not been cataloged. In this 
aspect of the invention, the actual image information 
contained In the pixels comprising portion 200 of the im- 
age or by an analysis of this information resulting In cer- 
tain characteristics of this information is used by the pro- 
gram to search non-cataloged images for similar or 
nearly matching image infomiatlon contained in the pix- 
els of the non-cataloged images. Upon finding such im- 
ages, the program causes the meta data associated 
with the icon created in step 1 06 of Fig. 4 to be appended 
to the newly found Images. An example would be that 
an icon of the face of an Individual would be created. 
The stored maximum pixel resolution correlated to the 
created icon would then be analyzed to detemilne cer- 
tain characteristics. These characteristics would then be 
used to review non-cataloged images and when images 
having these characteristics are found, then the icon 
con-elated to that face of that individual would be asso- 
ciated therewith. 

[0034] In this application the pixels of the icon are an- 
alyzed for outline patterns. The images to be reviewed 
are analyzed to see if these patterns exist. When a 
match is found this is an indication that the image of the 
icon is present in the reviewed image. Using the forgoing 
technique non-categorized images can be quickly and 
easily cataloged with little or no review by the user. 
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Claims 

1 . A computer software product comprising a compu- 
ter readable storage medium having a computer 
5 program which when loaded into a computer of an 
image forming devtee causes the computer to per- 
fonn the foltowing steps; 

displaylng at least one Image for categorlza- 

10 tion; 

providing at least one selection category having 
at least one image association icon that can be 
associated with the image to be reviewed. 

>5 2. A method for organizing a plurality of images com- 
prising the steps of: 

- displaying at least of said plurality of images; 
categorizing said at least one of said plurality 
20 of images using an image teon for at least one 

selection category. 

3. The invention according to daim 1 or 2, wherein 
said at least one selection category comprises five 

Z5 selection categories. 

4. The invention according to claim 1 or 2, wherein 
said at least one Image icon comprises a plurality 
of icons. 

30 

5. The invention according to claim 1 or 2, wherein 
said at least one icon Is associated with a corre- 
sponding text. 

35 6. The invention according to claim 1 or 2, further com- 
prising the step of: 

providing an additional selection feature for 
adding customized Icons. 

40 

7. The invention according to claim 6, wherein said 
toon is obtained using the image being categorized. 

8. The invention according to daim 1 or 2, wherein 
*s said at least one selection category comprises at 

least one of the following: 

Who; 
What; 

so Where; 

When; 
Why. 

9. The invention according to claim 1 or 2, wherein a 
5s working screen having a window for displaying of 

said at least one digital image and at least one sec- 
tion area for illustrating said at least one image as- 
sodation Icon. 
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10. Hie invention according to ciabn 1 or 2, wherein 
said software product further provides the steps of: 

providing for the addition of a new image Icon 
for use In categorizing. s 

11. The invention according to claim 10, wherein said 
new image icon is obtained from said at least one 
image for categorization. 

10 

12. A computer software product comprising a compu- 
ter readable storage medium having a computer 
program which when loaded into a computer of an 
image forming device causes the computer to per- 
form the following steps: is 

retrieving at least one image from a plurality of 
images that have been previously categorized; 
providing at least one selection category having 
at least one Image association Icon that can be 20 
associated with the Image to be reviewed. 

13. A method for retrieving an image from a plurality of 
Images that have been previously categorized, 
comprising the steps of: 2s 

retrieving at least one image from a plurality of 
images that have been previously categorized; 
providing at least one selection category having 
at least one image association icon that can be so 
associated with the image to be reviewed. 



1 7. A method for personalizing an image computer soft- 
ware program, comprising the steps of: 

a. providing a categorization/retrieval program 
that uses categories and image Icons for use In 
categorizing and/or retrieving digital Images; 

b. selecting from a plurality of stored categories 
at least one selection category; and 

c. selecting from a plurality of stored Image 
icons at least one image icon for use with said 
at least one selection category. 

18. A method according to claim 1 7, further comprising 
the step of: 

adding a personalized selection category as 
determined by the user 

19. A method according to claim 1 7, further comprising 
the step of: 

adding a personalized image Icon for use with 
said at least one selection category or said per- 
sonalized category, 

20. A method according to claim 1 7, further comprising 
the step of automatically adding a new category or 
Icon to said program in response to information pro- 
vided with an image that is used by said program. 



14. A method for automatically organizing a plurality of 
Images comprising the steps of: 

33 

providing at least on Image icon associated with 
a catego7, 

using predetermined characteristics of said 
Icon for use In identifying non-categorized im- 
ages for association with said category. « 

15. A method according to claim 14, wherein said pre- 
detennnined characteristics comprise analyzing the 
pixel content of said image Icon. 

16. A computer software product for automatically cat- 
egorizing images comprising a computer readable 
storage medium having a computer program which 
when loaded into a computer of an image forming 
device causes the computer to perform the follow- so 
ing steps: 

providing at least on image icon associated with 
a category, 

using predetennined characterlstKS of said 55 
Icon for use in identifying non-categorized im- 
ages for association with said category. 
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